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This paper is a review of some of the issues, 
dilemmas, and constraints in the evaluation of juvenile corrections. 
Included are such problems as: (1) adequate assessment criteria; (2) 
insufficient controls in experimental designs; (3) the conflict 
between humaneness and effectiveness; and (4) the measurement of 
program goals. A critique of six studies in juvenile correctns 
provides examples whose strengths and weaknesses can serve as 
quicklines for further refinement and elaboration of evaluation 
methodologies. The process components of these studies, rather than 
their outcomes, are emphasized. The thoroughness with which the 
researchers evaluated programs is summarized in a series of charts, 
one for each of five dimensions; (1) subject population; (2) setting; 
(3) treatment technology; (4) process variables; and (5) outcome 
measures. The authors conclude with a delineation of a plan for 
comparative assessment involving the classification of the functional 
categories of juvenile corrections into four major groups; (1) 
detention programs; (2) processing; (3) change and control; and 
re-integration programs. (RHP) 
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Once upon a time, 19A0 to be exact, a coclologlst wrote 
• of a strange community to which men were tcniporarily 

baniened because they x/ere possessed by evil spiritc. 
Although high priests were sent to visit the banished men, 
their efforts to drive out the evil spirits proved in 
vain. The banished men resisted the efforts of the high 
priests and withdrev; from them, speaking in a strange . 
language and living by rules foreign to the high priests • 
Under thsrje conditions, the cvii pplrlts in many of the 
men, instead of withering away, i.rxareascd and multiplied. 
Thus, when the men ware finally r.llot/sd to return to the 
land from which they came, the people found them possessed 
by spirits more numerous and more evil thsa before, and 
they caused the men to be banished again and again. (Slosar, 1972) 

More thaa thirty yefirs ago, Clemmer (1940) presented his prisonization hypothesifr 
about the effects on human beings froxn isolc'tilon In. closed institutions. Although th'r 
prison cpitouiises the extreyiio in corrections programs, it is probable that all correc- 
tional programs are afflicted with the "gr\m reality" of ineffectiveness in the rehab? 
litation of offenders. Certainly juvenile corrections is no exception! Evalu;ation oi 
program processes and outcomes has been l«sss extensive than in adult corrections, but 
it is still appai^ent that juvenile intervention seldom succeeds to anyone's sat'.isfact: 
The juvenile justice system is falling far short of its objectives: serving the best 
interests of individual youth and contributing to public safety by controlling and 
reducing youthful crime. Disappointment with juvenile justice is especially strong 
because of the humanitarian hopes generated by the founding of the juvenile court ait 
the beginning of the century. One method for resolving at least part of the diffi- 
culty is to focus greater resolirces on thorough evaluation of correctional programs s< 
that decisions can be made on the basis of greater knowledge about the probability of 
attaining a given outcome from a specified program of intervention. As in other humat 
service organizations today, ev^.luation is one of the "in" activities in jtivenile 
corrections. Legistlators and boards increasingly request that there be systematic 
evaluation of newly-funded programs. Unfortunately, very little of the activity that 
is subsumed under "evaluation" could he classified as research, but there is a consis- 
tent groping for more effective methods of intervention. Any review of the evaluative 
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research literature in Juvenile corrections would draw essentially the same con lusioi, 
as thoG3 drawn by Rossi in his acsessmeat of the evaluation of poverty, educatioa, and 
other social action programs (Rossi and Williams, 1972) • He concluded that there were 
few sufficiently powerful reoearch designs among those studies to permit unequivocal 
ctatcments thr»t coul^ be used for policy fornulation. 

This paper reviews some of the issues, dilemmas, and constraints in the evaluatio 
of juvenile corrections. It examines the implications of organizational goals for the 
evaluation of processes and outcomes, cud following that, a series of contracting 
/ studies of juvenile corrections are analyzed with reference to thoir goals, character- 
istics of subjCiCts, treatment technologies?, organisational effort and process, and 
outcomes. Societal values as a constraint on criteria for assessment and on means of 
intervention are considered along with particular problems of measurement in this , 
category of hhwan service organinationa. Lastly, elements of the plan are prcpoGcd 
for the evaluation in which we are engaged at the present time. Vlhen this plan is 
fully operationalized, we hope that it will enable us to assess signific^t aspects oi 
the effectiveness of variant types of juvenile correctional programs in a large niambev 
of s^:ates. 

ISSUK3 AIK)^ DIUE MMAS 117 EVALUATICn 

What should be evaluated in the assessment of juvenile corrections? At least 
three orders of phenomena are of importance in any evaluation that has explanatory, as 
well as policy, implications: 

(1) the personal and social characteristics of the target population that the 
organization seeks to change; 

(2) the structures and practices wi chin the organization that must be implemcnte- 
if an offender is to be changed from Condition A to Condition B; 

(3) the inter-organisaiiioiial exchange among units within or linked to the juveni 
justice system that have consequencea for the varying careers of Juvenile 
offenders. 

£1^^" Most evaluative research to date has addressed the personal and social character! 
tics of the individual offender — personality, behavior, values, attitudes and 
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capab;llitie8 (Schrag, 1971; Suchtmn, 1967). Insufficient attention has been dixacted 
to organizational goal implementnr.ion, stability and adaptability, technological fea- 
oibility, referral rates, and organiiiational structures required for quality perfor- 
mance (Mott, 1972). Programs typically are judged as effective; or ineffective by re- 
ference only to individual level results (California Youth Authority, 1973). More- 
over, even the latter type of evaluation often fails to consider sufficiently the 
selective input of offenders into different types cf programs. Whpn selective aoflign- 
p.rat occurs, as it does in most correctional classification, methods must be devised 
for taking this factor into consideration before there can be coHiparative evaluation 
across programo or organisations. '^Tracking'- is cn obaet-vablo phenomenon in juvenile 
corrections as it is in public schoolo and other human service organizations (Gicourel 
and Kitsuoe, 19G4; Berghardt, et al, 1971; Sarri £t al , 1970). Again, individual 
characteristics are used as the basis for assignment to a given program which has a 
greater or lesser probability for successful outcome, independent of those individual 
characteristics. For example, a juvenile assigned to probation has greater opportun- 
ities for education and employment than most youth assigned to ixxstitutions. Yet the 
criteria for assignment may be race, sex, family composition and so forth, character- 
istics unrelated to ability to take advantage of education or emplojrtnent. Further- 
more, "time of the year" is a factor that may affect the processing of :a juvenile. 
The probability of commitment by a juvenile court to an institution is lower in the 
spring quartile than in other months of the year because the court is likely to have 
expended its resources tovrard the end of the fiscal year and cannot afford institu- 
tionalization. In addition to the above factor, there are many other organizational 
conditions which should be considered in evaluation, but too often they are ignored 
or an. assumption about randomized effects is proposed as a general explanation* 

Standards of . performance at the organizational and inter-organlzatlonal levels 
have been almost non-existent In corrections; where they were found, they were based 
largely on the collective subjective opinions of administrators. Objective criteria 
and on-going program evaluation are only now being developed* At least five categories 
ERs^C of criteria can be delineated for organizational evaluation to then be linked with 
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outcome evaluation. These incluclat (1) effort (e.g., cost, time, and types of 
personnel expended to achieve goals); (2) 1 wel of performance (e.g., the number off 
individuals who complete Program X from thoco vho enroll) ; (3) adequacy of porfor - 
ixicncje (e.g., value of the pic^gram to offcndc/rs); (4) efficiency (e,g., relative cost 
of Program X); and (5) cYRunizationnl processes (o^g., program attributes which relate 
to success or failure, recipients who bcr^efit, service delivery, and first order 
effects produced during the period of intervention) . 

Rectdlv lrm; A Critorlon for AJA Sc ^s ovir ' 

A oecond ?.nd equally iriportaTit question is: Should recidivism be the priri^ary , 
outcome criteria in the evalustion of juveirile corr actions, and if so, how is it to 
be defined? Whon one thinks of ef:f cctiveneas and oiitcomes in corrections, the con- 
cept "recidivism" inevitably is considered. Ilcct often it is used to refer to some 
abrjcjvie men stir emerit of poet -program law-violatlve or morally disapproved behavior. 
This is particularly problem*?.tic in the case of juvenile offenders because data abouc 
recidivism reinforces the "criminal" label; yet, a large proportion of juvenile 
offenders in many programs are guilty only of status offenses — truancy, running 
away, promiscuity, incorrigibility, and so forth. None of these behaviors are crime;, 
for adults^ but ju^i/enile "recidivists" are labeled as law-violators along with adultii 
who commit felonies. Even in states or communities where status offenses are not 
sufficient basis for state intervention ^ t:heir repected commission may be a basis 
for the label "recidivist" and for incarceration, often in jails and for longer 
periods of time than for offenders who do violate the law. 

Another problem associated with the uoe of recidivism in absolute rather than 
in relative terms is that positive results may be obscured. Thus, a single arrest 
or violation is enough to classify the person as a "recidivist" and an outcome 
failure. , If recidivism is conceived in relative terms, there is an expectation that 
the program will result in fewer and less serious offenses by participants, ^e 
addition of oV:her outcome measures reduces reliance on recidivism as an absolute cri- 
^'^'^ia. Thuo, positive changes in education, employment, family life, and so forth mc 
wttmm linked to program experiences. The recently published results of the Provo and 



Silvnrlake Experiments (Empey and Erickson, 1972; Etnpey and Lubeck, 1971) indicate very 
closrly a relative reduction in the seriousness and frequency of lav^'Violatlve behavior 
when pre-program results are conipared with post -program behavior. Furthermore, they 
were also able to Identify important differences in behavior in relation to age. 
Their findings are similar to those obtained by Miller (1962) in a study of a communit/ 
^delinquency prevention program. Both observed that the program results varied accord- 
ing to the age of the youth at the time of entrance and exit from the program. These 
patterns could be linked to general patterns of criminal behavior for all youth at 
different ages. Thus, youth who entered the program at younger ages would be expected 
to demonstrate a slower reduction of criminal behavior from those who entered and 
left at older ages because criminal behavior peaks in the late teens and then, tapers 
off sharply^ It is also possible that other general developmental patterns of youth 
will produce variable outcome patterns from similar program expieriences^ When known, 
x'heae can be considered in the program design and in the development of "base expec- 
tancy" criteria for the categorization of populations according to the probability 
of success or failure in the conasunity. H^berg and Ericson (1972) argue that if 
recidivism is to be used meaningiEully as an outcome criteria, it must be conceptuali2ecll 
a3 a continuum with variable probabilities developed for progriams and individuals^ 
They also assert that it Is wholly unrealistic to expect "total conversion^* as we 
apparently do at the present time in measuring change from criminal to non-criminal 
behavior. For purposes of program planning, knowledge about the length of time and 
phases of change are as important as ultimate outcomes. 

Recidivism is also a problematic criterion for the measurement of effectiveness 
because it obscures differentiation between short -run and long**run consequences for 
the society, in the case of youth, that intervention which may protect society in 
the short-run (e,g,, incarceration in a closed institution) may have long-run nega- 
tive consequences and vice versa. The effectiveness of any interventicn is to be 
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assessed on the baale of its ability to rehabilitate and reintegrate Juveniles into 
^ meaningful social roles, not merely to reduce immediate law*vlolative behavior, 
ERIC urthermore, over-reliance on absolute measures of recidivism obscures negative or 
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no Impact from correctional experiences. Par too few studies ever measure negative 
impact other tihan recidivism, despite general awareness of the inevitability of this' 
outcome in many programs. Were these data to be made as routinely available as is re- 
cidivist data, opportunities for change in custodial programs might be vastly increks- 
(Kassebaum^ Ward and Wilnsr, 1970). Only recently in the plethora of legal actions 
against correctional agencies has there been any substantial effort to measure nega- 
tive impact. 

Ward and Kassebaum (1972) contend that the lack of concern about the overwhelmirt 
evidence of negative results from correctiorxal intervention occurs because dcpartmeutc 
of corrections are cciicorned more with surveillance and control than rehabilitation. 
Thus, it makes little sense to measure their present outcomes in terms of rehabilitate 
individuals, because that is not their primary goal. Obviously, much evaluation has 
failed to address this phenomenon. " I 

The unreliability of crime statistics and the manipulation of data by administra- 
tive boards, police and other agencies io nuother reason for caution in the use of 
recidivist data in the evaluation of correctional prograrts. Police, courts, parole 
boards, and other agencies may seek to improve or depreciate the public status of a 
particular program and, in order to do so, the data about individual behavior may be 
covertly manipulated. The unreliability of crime statistics was recently documented 
in an analysis by Seidman and Couzcns (1972). They analyzed police reports in sev- . 
eral metropolitan communities and observed reports of reductions in selected types 
of crime which corresponded with political pressures to reduce such crime. Thus, 
they conclude '"crime statistics. . .are highly misleading indicators of what they are 
used to measure, at least in part, simply because they are used ias measures" (p»29). 
•It has also been recognized for a long time that persons in programs or releasees 
may be surveilled 3|nd harrasscd by law enforcement officials fair more than the 
rest of the population. 
Experimental Pesiro Dilemma g 

Thus far, we have been concerned with isstaes in evaluation that involve measure- 
mt of outcome. Another sot of issues which has been discussed exctensively in 



recent yosrs in the evaluation literature concerns problems in the use of experi- 
mental designs (Weiss, 1972; Rossi and Walker j 1972; Caro, 1971). Seldom do re- 
searchers in juvenile corrections hav4 the authority or resources to exert the nec- 
essary controls required by powerful e:;perimental designs, nor are they abl8 to mes 
sure objectively ultimate and process goals as thcise relate to behavioral outcome 
criteria. Ilany assume that correctional decision-makers can select variable types 
of programs for youthful offendlirs; thus, there should be few limits on application 
of experimental designs in evaluation • Seldom, Ijotjevor, do administrators have sue! 
diccrction; in fact, in many communities, judges wholly control v^hera juveniles 
will be placed, for how long, and xihcn they may return to their home commvailties, 

Campbell's (1966) proposals for quasi-experit ental der.igr.s offer some solu- 
tions for sound evaluative research, as do those by Guttentag (1971) for decisionr 
theoretic models. Aosumptions about interchangeability of units and definitions 
of variables must be made with great caution, Guttentag (1971) points to some of 
the problems which occurred in the WccOtinghouse Study of Headstart programs where 
the assumption was made that these programs throughout the coimtry could be viewed 
as unitary variables. Our field research in jisvenile corrections in several statec 
indicates clearly that regJ.onal, cultural, and socio-economic differences must be 
examined and controlled if comparisons are to be made among organisations and per- 
sons. Furthermore, statutory variations and judicial decisions may dramatically 
alter conditions in the middle of an evaluation experiment. It is ine^/itable that 
much research in corrections will continue to be done on a non -experimental basis, 
but knowledge about effectiveness' in corrections can evolve as a consequence of 
multiple types of experimentation rather than from a few definitive classical ex- 
periments. 

Humaneness and Justice vs. Effectiveness 

Recent statements by organizations such as the American Friends Service Com- 
mittee (1971), the American Association of University Women (1970), by social re- 
searchers such as Lentjan (1968), as well as judicial decisions have highlighted 
consideration of the relationship between effectiveness and conditions of fairness. 



aud jiist'f cc In the operation of correctional programs. The National Con* 

fererce oxx Criminal Justice (1973) haa now articulated a eet of standards which pro- 

\ 

vide behavioral guidelin©fl vegoxding humaneness and jxt^ilca. Enforccinent of theoe 

J ^ 

stand^irds ^through the courts vill undoubtedly have an Impact on program operation and 

evaluation, for not only is |tiV3 ''right to tvoacment*' at issue, but so are the general 

'1 I 
r.ocial and physical conditions under vhlch the Juvenile offender must e:;ist. It is 

posBible for a program to be effective (at least hypothetically) and yet not meet cri- 
teria of huTuiTieneos, fairnoc^s, and justice. The evidence, however, apreorcs to be over- 
xchalming that the^e throe conditions are necessary to, but not sufficient for, effsc- 
tiveneos. 

Behavior modification tGchnologles and the conditions governing their use pose 
another issue to be addressed by those interested in evaluation of such progrsm^. More 
and more juvenile correctional programs are instituting beha\'ioral modification toch- 
uolo,r|iG3 and recently, electronic def/ices for remote observation and control of beaavic 
have been proposed for Juveniles, as well as adults, by Ingraham and Smith (1972), and 
by Schwitsgebel (1967). There is conoidetable debate about the use of these latter 
technologies, but the position paper by the American Friends Service Committee (1971) 
and the legal critiques by Shapiro (1972) and his colleagues in Southern California 
(1972) raise broad philosophical questions about freedom and psychic autonomy. Itigrahai 
and Smith (1972) argue that electronic and other behavioral ooutrol procedures are pre- 
ferable because the offender who accepts those dcj/icos has far greater .freedom in other 
sectors of his life than if he were incarcerated. In rebuttal, Shapiro (1972) asserts 
that there la considerable risk of abuse of these technologies and that if behavioral 
control through electronics is instituted, we will have effected a fundamental change 

in values about personal privacy and freedom. Thus far, evaluators of behavior modi- 

i 

flcation technologies in juvenile corrections have avoided dealing directly with these 
issues in their assessment of programs, but they will need to be addressed in the near 

I 

future. Obviously the use of any Interpersonal change technology raises ethical dil- 
emmas regarding freedom of choice. The external manipulation of behavior should not 
pursued %?ithout reference to the social values at issue. More than a decade ago, j 



Krasner (19 2) offered the following caution about the use of these technologies: 

Behavior control represents a relatively new, important and ' 

very useful development in psychological research. It also 

may be horribly misused unless the poychologirit is constantly 

alert to what is taking place in society and unless he is 

active in Investigating and controlling the social uses of 

behavioral control, i 

Our delineatilon of Issues and dilemmaef In evaluation in JuveniJaB correCi:ions 
would be incomplete if we did not refer to involvement of the offender population 
directly in the assessment of the program. Much evaluation is completed in correc- 
tions without any direct participation of offenders, and where they do participate, 
it is only to comment positively or nfiiiativoly about the program as it is presented 
to them. They are not pemluted to formulAto c^Kpectations or suggest -mEaas for 
achieving objectives. This continues despite the s'uggestive data in the literature 
that one's expectations and aosessmento are criticaiiy linked to one's bahavior. 
Certainly, this is the cane when negative consequences occur. The youth who views 
his explerisnce negatively, who is pessimistic about the future and his behavior is 
not likely to succeed in post-progrsm situations. Youth are commicted to correcXiional 
programs for vastly different behaviors and attitudes yet much evaluation starts 
from the assimiption that there will be similar responses among offenders given a 
standardized program experience, 

PR0gMT4 GOALS - - CAN THEY BE MEASUP.ED? ) 

i I! 

Mott (1972) and others have proposed that effectiveness is to be defined with 
reference to the extent to which organizational goals are attained. Difficulties 
arise because of the^ ambiguity of the goals of corrections agencies, because some 
goals may be covert, and because thexc may be actual or potential contradictions 
among multiple goals. For example, protection of society is a typical goal in a 
correctional agency, but if it is carried to an extreme state, it would mean that an 
agency would seldom release an offender who was a "risk". Not to do so, however, 
would jeopardise the goal of rehabilitation. 

The researcher, in his effort to measure organizational goals, must distinguish 
^Y^C ^^^^^^ ultimate and process or intermediate goals. These objectives must then be 



10 

I 

linked to each other as we suggested earlier and they must also be measured in 
relation to the behavioral outcomes for juvenile offenders. Implicated in any 
effo'rt at delineation and measurement of organizational goals is the definition 
of the problem that ts or vill be the tHTf^e:: for change. The way in which the 
problem is defined influences the means of intervention for resolution of the 
problem. Thus, if: delinquency is defined primarily in terms ojE the ndividual 
person rather than in relation to the peer group, neighborhood, or other social 
situation, the goals, targets, and technologies should relate to individual level 
phenomena. On the other hand, if the problem is viewed as situational,, the physical 
social or economic enx^ircnments would be the targets for change. 

The use of goals in e^^aluation is also complicated by lack of clarity in both 
definition and in measurement techniques, Objective procedures for measurement of 
organizational goal attainment are presently not available for human service organi- 
zations. The research, therefore, must examine official mandates, objectives and 
priorities of the ei^ecutl^ cadre, and staff perceptions of what should be the desirt 
ends for the organization. The latter approach was utilized by Ullman (1967) in ht^^ 
study of the relative effectiveness of mental hospitals. He developed two normative 
meaSjUres of outcome which were independent of organissational definitions of the 
phenomena. The normative approach was the basis for recommendations of the Presi- 
dent's Commission on Crime, and in the recently published Criminal Justice Standards 
of the National Advisory Commi^esion on Correctional Goals and Standards (1973). The 
general assumption underlying these normative approaches is that the primary functio: 
of juvenile corrections is the rapid reintegration of the offender into his usual 
social roles with as little severing as is possible of ties xd.th the external envir- 
onment throughout the period of intervention and/or incarceration. Given thin 
assumption, goals of custody and protection are of secondary importance and should 
GO be assessed in evaluation. In the case o'f juvenile corrections, there is wide- 
spread consensus that the primary mandate is rehabilitation, but when staff percep- 
tions are measured custodial ends often are assei^ted to be of equal importance. Thu. 
evaluative procedures have to include multiple measures and variable weighting of 
moal priorities if these are to be utilized appropriately. The analysis of 
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six programs in the following section highlights somo of the many problems involved 



in defining and measuring goals and in tracing out the consequences of goals for 
program perforr^ance. 

A Critique of Six Studies in J»iv e nilo Corrections 

Six studies which deal with evaluation in juvenile corrections wnre selected 
to illustrate a variety of oottings, programs, and populations, end to highlight 
variable questions and modus operandi for this kind of scientific endeavor. These 
selected studies are not representative of the entire range of research in this area, 
nor do they necsssarily reprssetit the most fruitful work. Rather, they are oramples 
whose strengths and veaknesi^es can serve a« guidelines for f;;i:!:her refinement and 
elaboration of e«?aluative methodologies. 

These^six studies encompass a selection of recp^rch in juvenile corrections 
over a fifteen-year period — research which looks at a variety of ways of trying 
to effect change ^in youth in a variety of settings in various regions of the United 
States. The researchers were involved in different ways with both the subjects and 
the setti-ags in which their research took place. To assess this research, a frame- 
work was developed which emphasizes process components of effectiveness studies 
more than outcome measures, becauce it is the former which have received less atten- 
tion at the organisational level and it is these T;hich must be manipulated in pro- 
gramming . 

First, the subject popul ation what personal aud social background charac- 
teristics were measured, what attitudinal, behavioral and personality charcteristica 
were aasecsed, and how were subjects selected. If there was both an experimental 
and control group, how were they compared and were they adequately matched? To what 
extent were these differences in the subject population r<iiated to later differences 
in outcome? 

Second, the setting in which the intervention took piece — the milieu and 
situational chrvracteristics, the characteristics of staff both in terms of background 
and attitudes, the goals of the program, the inter-organization^L network in which 




upon 




program 
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goalso i'o vhat extent aire these prcBxaias differentiated along organizational 
dimensions, and if they are, how are these differences considered in the overall 
evaluation of the program? 

Third, the treatment technolog y being need on the eiubject population* Are the 
intervention strategies or technologies being used clearly and precisely specified 
and are there real differences for the control and experinc?ital populations? Can 
we separate the effects of various segmcntB of the intervention process? Is the 
technology contieteut over different periods in the history of the project and, if 
not, are these differences taken into account? 

The next step is to examine to what extent they sought to diccovcr the e£€fyrt 
expended to effect change. One cannot really couipare technologies or programs with 
regard to their intrinsic value if they are not implemented w?.th the same degree of 
intensity and if they are differentially embraced or resiated by their subject 
population. To what cr.tent are the efforts of staff, the efforts of subjects, the 
efforts of the organizatidn, and the efforts of the community analyzed in relation 
to a discussion of the technology and its effects? If there are differences between 
the experimental and control programs, are differences in effort variables looked 
at as possible explanatory factors? \ 

Process variables are defined as the effects produced during the period of 
intervention. These include the effects on a short-run basis, i.e., prior to 
termination or at the point of termination from the program. For reasons asserted 
earlier with regard to recidivism, process effectiveness measures are assumed to be 
of crucial importance in evaluation and should not be viewed as inherently "softer" 
data than long-range effectiveness measures. Along with traditional types of process 
measures such as offenders^ .attitudes toward self, expectations for succesi^ on the 
outside, and views toward peers and staff; other behaviors engaged in during treat- 
ment are also considered including: objective measures of achievement while in the 
program and at point of termination, and preparation for future roles given by the 
program* The extent to which researchers examined humaneness, fairness, and justice 
for the subject population will also be considered* Also, examined are length of • 
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otsy, costs of program, and proportions of subjects completing the prosram, fnillng, 
or dropping out, as veil as process effects on the staff and organization. 

Finally, the outcome or pcrformaace i^ g^aotxres are analyzed as is the extent to 
vihich these are related back to the other aspects of the analysis. For exciinyle, to 
what extent are differences in rccidJ.viera related to differences in subject charcc- 
teriotics and the effort expended ty the subjects during treatment, as well as to 
differences in the treatment technology? In x;hat different ways is recidivism mea- 
flurea and hov adequately? To what e:;.cent are other measures utilized, ouch as sta- 
bility and survival of the program itself, morale and quality of the staff, degree 
of community cccpe7:ation and concern with the program, as well as behavioral measure<:> 
of the subject's long-range adjuotmnnt through vocation and education^ \ 

"gocial Structure, I dentification , and Charuxe in a Treatment - Oriented Jnatltution ," 
Ray mond J. Aci^amnk and Edward Z . Dap. er, l^coT 

Charac terigties of sui^jecl'S . The subject population conoisted of the universe 
of girls resident in the institution and d&ta are given about the variable percent- 
ages of these girls with respect to several background measures. No comparative 
information provided about the distribution of these background characteristics 
for other ins^.itutionalized female delinquents. The institution had a selective 
admission policy with respect to age, educational level, and severity of emotional 
disturbance. ^ 

Subjects were also characterized by their entering scores on the ICL^ the MMPI, 
and the IPAT Anxiety Scale, which were administered by the institutional staff at 
intake. These data were used without reference to the situational characteristics 
which might have affected responses. 

Only five\ subject characteristics intelligence quotient, social class, 

\ ' ■ 

religion, age at entrance, and length of stay were analyzed for relationships with 
degree of change. They found that length of stay and age at entrance were signifi- 
cantly related to change and degree of Identification with staff, so these variables 
were control^led in the analysis. 
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Interventio n setting^. The intervention setting vas described in terms of its 
locntion, auspices, authority structure, and staffing, and structure and mechanldms 
of ooclal control, as they affect inilieu« These data were apparently gathered 
through observation, analysis of institutional documents, and questionnaires to 
residents. Goals of the institution were not clearly identified nor was there eny 
indication as to how they were operationalised; thus effectiveness cannot be measured 
VJith respect to the environmental context, only sketchy information was provided 
and there were no data about the opportunity for or frequency of contact with local 
community people. Inforination is needed ahcut the extent and degree of available 
outside contact and the degree of congruence between the inteivetition setting and 
the usual social roles to which resident!? will return, for these are important in 
accounting for the success or failure of efforts to integrate off^uders into 
conventional societal roles. 

Tr eatn>ent / 1 echno lopry . The most distinctive aspect of the treatment technology 
was that it was highly- structured, unambiguous, and consistent in the patterns of 
reward and punishment. It was described In terms of its mechanisms of social 
control, but no information was given about sanctions or rules. Also not 
presented was information about the relative emphasis of the individual or group 
in treatment, the problem focus of staff, the kinda of diagnostic categorief3 or 
classification schemas used, and the variety of techniques employed* 

Effort. Information about contact with group mothers was provided, but there 
was no data on frequency of contact with social workers, psychologists or psychia- 
trists, number of hours spent in school, empVaslo placed on group or individual 
punishments end rewards, or even the kinds of contact and the quality of contact 
of staff with girls. Two effort measures of students — service as a group leader 
and conformity to Institutional norms — were related to the degree of indentlfica- 
tlon with the institution and staff -- a process variable. It would have been 
helpful had the authors also analysed the relationship between those effort measures 
and outcome variables but this was not done. 
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Process, Prow'jess measures of intoxe^t to the authors vcre: identification 
of students with the staff and inctitution, and degrea of change in self- est eciin, 
f.3ith in people, psyohological -behavioral adjustment, and anxiety. Th^y were 
not interested in any bchavioTal measures. 

In accounting for the development of identification with the institution and 
the staff, the researchers alluded to a number of other effects of treatment, or 
proc^iss effects, which were not measured but were described such as: reduction of 
peer interaction, little or no peer support for "'fishting the system," isolvition 
from the outside, too msich punishment for minor rule Infractions no legitimation 
of many of the rules by the girls, and so forth. Several of these po?:entially 
negative proccne effects required nystov.atlc study. 

The measures of change were calculated for girls at various stages in the 
treatment process > i.e., they w?.re not measured at point of termination, but rather 
all were obtniued at the same time regardless of the phase of treatment. As indi- 
cated earlier thexe was almor-t total rollr'jn/^e on psychological assessment as a 
measure of change. Although the average length of stay was 18 to 24 months, infor- 
mation was not given about what types of data were considered in release decisions, 
llo information was provided about changes in school performance, in peer relation- 
ships, in misbehavior, and so forth. Also unknom is the proportion of girls in 
this program who completed it, dropped out or were transferred. No information 
W4=»s given about program costs. 

Outcome or Performanc e. This study did not report any outcome or performance 
measures either at point of termination or after termination. All change consider nc 
was. change within the institution during the process of treatment. But, there was 
no certainty that any of these indicators of process change v7ere linked to any long- 
term changes for the subjects, either positive or negative* 

^ Fol lox-y-up S tud^tr of Boys Pfirticipatt>if> in the Positive Peer C ulture Propcram at the 
Klnn^ota Stcte TralnlnR School for Boys ; An A nalysis of £42 Beys Released Durinp; 
1969 , Mnnesota Department osf Corrections, June, 1972 . 




Characteriotlcs of Subjects . The subject population consisted of the boys 
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.raleasnd in 1969 from the Minnecota State Training School for Boys. All tha boys 
W3re characterized on numerous dimensions of background, but for only three of these 
characteristics — area of residence at admission (urban/rural), racial/ethnic back- 
ground, and intelligence estimate were any comparisons made between this Training 
School population and the male population la that state between the ages of 10 and 
IS'. And yet, comparioon after comparison wss made in these figures bet:v:een boyo who 
had their paroles revoked from those who did not. It seems likely that they collected 
Information on every background characteriotic that appeared in the file without any 
theoretical reason or conceptual framework for linking them to the depcno»int variable 
or measure of effect. This resulted ia a number cf comparisons between the backgroun-5 
charactoristics of beys vho&e paxolea were revoked with those whose paroles were 
not revoked being made without any really sound reason. Therfore, it was not surpris- 
ing that some significant relationships were observed. A number of the background 
characteristics which were analysed were never operationalized clearly, e.g. "living 
sii.uation" and "drug/alcohol and physical abuse". 

Several intra-institutional program characteristics were also studied in relation 
to the subjects that is, characteristics of the subjects that were related to 
their institutional experience. These included: the number of successful and 
unsuccessful truancies of boys from the institution, the differences in lengths of 
stay, the age at release from the institution, the school grade placement at release, 
the cottage lived in, and the living situtation after release as related again to 
revocation or, non-revocation of parole. A3 mentioned earlier, the reader was not 
informed as to how the data were collected, nor how variables were defined and 
operationalized. 

This study relied almost completely on the characteristics of subjects for the 

I 

explanation of effectiveness or ineffectiveness of the program technology. These 
characteristics of the subjects were relcted not only to the Incidence of parole 
revocation or non-r evocation, but also to comparisons between parolees and transfers 
ci from the institution* 




Interventioti setting. There was virtually no description or analysis of the 
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intervention setting. It would have bean helpful if the cottageS; vhich were analysed 
in terms of the differences of the characteristics of the residients, had been describe 
in terms of any organizational or structural characteristics. It is critical to an 
adequate understanding of the pxocecs of treatment to determine the significat>.t 
characteristics of the settings in which it occurs. 

Treatment/technology , According to the report, the technology employed in 
treating these boys was Positive Peer Culture (PPC) --a type of group therapy, based 
on principles of guided group interaction, which utilises peer pressure and staff 
guidance to treat delinquent youth. The description of PPC states that it was the 
basic treatmsrit tool of the institution. Group meetings five nights a week vere the 
focal point of the boys' daily activities. The group was also the focus for many 
other activities experienced by the youth in the institution. 

This is fine insofar as it goes, but It loaves great many qu^^sr-ions urjanowered, 
What kinds of behaviors or attitudes did this technology really try to alter and what 
kinds of behaviors and attitudes did it accept or tolerate? To what extent were, 
group meetings supplemetited by other kinds of counseling auab as individual counselir;. 
To what extent did the group reward and/or punish its members at times other than In 
group meetings? To what extent did all staff really implement the PPC program 
was it thwarted at all by custodial staff or other treatment programs? What parti- 
cular parts of the PPC technology were crucial for effective treatment and what 
parts of it were adjuncts whose modification would leave the program relatively 
unchanged? Were all boys in the institution really subject to the same technology 
or were there differences in its application,, intensity or staffing patterns that 
might, in fact, have been ri^lated to the success or lack of success on parole? 
There was a difference in the parole success rate of different cottages in the 
institution it is probable that some oi this might have been explained by differ- 
ences in the applicatioti of the technology in these different units. No effort was 
made to look at the actual implementation of the technology in the institution as a 
O Le, in different sub-units of It, for different kinds of loffenders, and by 

ERIC 

"SS?2erent kinds of staff* ?{hl« is a crucial deficiency In a study which seeks to 
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assess the effect of one kind of technology in a single institution. At the very 
least, it iff necessary to examine the operation of that technology in depth in order 
to ascertain vhy it was or vas net effective. 

Effort . Ideally, the effort expended by staff end boys in Imp lenen ting PPC 
should be considerable — after all, "they have the yeeponsibility to help and care 
for each other 24 hours a day". They met as groups five nights a week for 90 minutes, 
but no information was provided on the total hours of contact with staff or with each 
other in discussing and working on individual or group problems, how much in-service 
training was given to institutional personnel iu PFC, or how much of a commitment the 
institution itself gave to the program. 

Ho data was provided about the relative priority of the rrc technology in the 
regular operation of the institution, nor about supports provided by the institution 
for re-entry under a PPC technology, and aliso none about the effort and commitment 
by boys to the PFC program. Such differences in such commitment and effort might 
well be related to differences in the success of parole outcome and probably x^rere 
relcited to the selection of boys for transfer as apposed to those who completed the 
program. 

Process. The process measures included the numtier of truancies from the insti- 

grade 

tution, the success or failure of these truancies, academic school placement at re- 
lease, and the placement or livJ.ng situation at release. These measures were not onlj^ 
insufficiently defined but were also not easily comparable with other kinds of pro- 
grams. Further, they were always analysed for their relationship to the outcome char- 
acteristics of the subjects — whether or not they had successful parole outcomes — 
but they were not analyzed for possible relationship with personal and social charac- 
teristics of the subjects or to differences in treatment. 

Although information could have been obtained about attitudes and behaviors 
assumed to be influenced by the PPC technology, none of these were, in fact, obtained. 
For example, they could have h^d pre and post-program evaluation of school attendance 
and performance, employment expectations and behavior, attitudes toward delinquency, 
>peer and self, or relationships with parents and relevant others. The only 
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intra-organlzational variable vhlch was evaluated was transfer status. Transfers 
VP-re compared with non-transfers with several Important differences noted, l^jenty- 
three boys were trcnsferred to other juvenile correctional facilities because of 
repeated truancy and behavior which required closer supervision and control. But, 
theae transfers had fewer incidents of all types of truancy prior to admission than 
did the parolees. Why then did these boys run more than other boys at Red Wing? 
IJhat possible interactions might there have been between the program and the charac- 
teristics of the boys that produce-:! a propensity to run? These queoticns remained 
unanswered. 

Transfers were, on the average, younger and had a higher estimated intelligence 
level than parolees. A higher percentage of the transfers were from the Kotropolitan 
area and were minority group members. Moreover, there wore fewer known cases of 
alcohol, drug, and physical abuse among the transfers than among the parolees. Why 
these particuJar boys vere not able to complete the program was not answered despite 
the differential effect of this program on boys. Rather than simply stating, as the 
researchers did, that "certain strengths and characteristics may be necessary for a 
boy's gainful participation in confrontive peer group treatment programs, ''"it would 
certainly seem necessary to try and relate process measures to characteristics of 
the organization and treatment program, as well as to individual characteristics of 
participants. 

Outcome or performanco . The outcome measures used in this study were all ylari- 
ations on the general theme of recidivism. Of the 2t9 parolees, 51% had their parole 
revoked while 49% did not, and the comparisons betveen these two groups and the 
transfers were made in terms of the previously -mentioned background characteristics 
and intra-institutional characteristics. Revocations of parole were more frequent 
for members of racial minority groups, especially American Indians and Spanish Ameri* 
cans; for boys with more disruptive living situations; for yoxmger boys; and for boyi 
with more frequent truancies. In addition there were more revocations of parole of 
O boys released from certain cottages and for boys vith shortest lengths of stay in 

the institution. Along with this analysis, they collected data on the average number 
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of months on parole before violation (6 • 8 months), the offenses resulting in 
revocation of parole, and the institution to vhlch the revocations were returned. 
No other measures of outcome vere attempted. 

Girls at V ocational High: An E xperim<^:at in Social Work Intervention ^ Henry J. 
Meyer , Edpar F. Borgotta, agd W yatt C. Jones > 1965 , . 

Charac t eristics of Sublects , The subject population consisted of 400 girls 
who entered Vocational High between 1955 and 1958, and who had been identified as 
potential problem cases by the research staff in their exaciination of the school 
records. From this pool of four entering groups of students in four different years, 
a random procedure was i^scd to select the g£rlc» for the experimental and control 
groups. Comparisons were made not only between the experimental and control groups 
on a variety of background and eccial characteristics, but also between the whole 
group of identified potential problems and the remainder of the high school populatio 
of the school - 

Differences were obsserved among these girls identified as potential problem 
students and others on a nuTiber of dimensions, most of which were in the expected 
direction. The data indicate that the random procedure for selecting experimental 
and control cases among the potential pr::blem population resulted in generally simil? 
groups, at least on those variabfes for which comparisons were made. 

Despite elaborate procedures devised for tapping background and social charac- 
teristics, these characteristics were, for the most part, not used in the later 
analysis of effectiveness and content of service. The reason for this we do not 
know, because many of these characteristics might well be related to outcome and 
would present a more detailed and informative picture of the actual process of inter- 
vontion and its effects, Fc|r example. Individual therapy might be more effective 
for certain types of girls and group therapy more effective for other types, perhaps 
dependin^s on racial background, sibling structure, or personality type. 

Intervention setting. All subjects attended a vocational high school in New 
York City which had an enrollment of about 1,800 student^ admitted from all over the 
^sity. Subjects who had been randomly assigned to the experimental group were 
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veSexxed to Youth Consultation Service, a private non-sectarian social agency for 
individual casework and b^^^^P therapy. 

During the evaluation, a decision was toade to switch from individual to group 
treatment because of evidence that it xjould prove to be more satit^factory. The 
approaches differed in their settings — caeework in the traditional agency setting 
and groupwork in a more relaxed community setting . Although this was net ever expli- 
citly stated, the differences in the setting alone could have been important in 
accounting for the differential impact of the two treatment mndalities. 

She goals specified for intervention were vague and ;^iot well-defined. They 
essentially revolved around trying to interrupt potential deviant careers and assumed 
that the ageiicy vas successful in diagnosing potential problems. Treatment objectives 
appeared to be multiple and individualized, so there were very real problems in defin: 
effectiveness critp.ria. There Wris no iufonmation as to how many regular staff members 
vere involved in this experimental program, the actual ratio og staff to girls in 
various phases of the project, the b?icki],ron:".d characteristics of the staff that might 
be related to their differential effectiveness in working with these girls, or the 
relative priority of this project in the oa-golng functioning of the agency. 

T r ea<:ment/ technology > Originally, the project sought to use casework services 
on an individualised treatment baeis as the primn:':y technology, but in the second 
year, they shifted to a process of group referral and treatment,' These two technolo- 
gies were compared and evaluated alor^g with the comparison between the control and 
experimental groups, Unfortunately, there was a wholly inadequate presentation of 
the difference 3 in the two technologies and how they were actually impleiiented. 
Thf^'e was a much better description of the ways in which the group treatment processc 
operated than of the ways in which the individual treatment processes worked, pxchablj 
because group treati)ient was seen as more novel and interesting in this setting. 

Effort . Fairly complete information was provided about the efforts made by the 
school, the agency, and the girls to implement and maintain this program. Effort 
rariables on the part of the school and agency included: provision of physical facil- 
aities; scheduling changes; orientation of staff and shifting of resources, staffing 
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potnnrns, and treatment strategies. For staff, there were mea&ures of contact vith 
parents, number of Interviews and content and depth of svonp sessions. In addi>:ion, 
the data indicated that, for the vhole experimental group, 957o received some treatment 
r»crvices and half of these had 17 or tiioxe treatment contacts with social x^orkere. 
ThcrGfore, the eicpcriemental group was clearly well-exposed to the therapeutic program 
In addition, girls in the experimental group reported more help from social workers 
and rcscnrchero than did Sz'J^.osa in the control group, liie reso(?rchers vTcre scncitivo. 
to ^their ixapaot-^on the situation. Other effort measures collected for the e:<perimen;.*i 
girls included judgeaeuts by the caseworkers and group therapists about thtlr clients. 
Tas caseworkers felt that not nanv of th^riir clients bscame seriously involved in a 
treatment relationship on an itjdividual basis, but this was not the Ctise for girls 
involved in group treatment. 1}x}£oTtv:aat(-ly ^ the girls tbemselvefl were not asked to 
rata their osm effort, and we have no information on the niimber of missed appointments 
or instances of late appointments. 

?re ocess. Because of the lack of precision in defining goals and technologies of 
this program, the researchers were confronted with a real problem in assessing effec* 
tiveness. They tried to resolire thia dilemma by presenting an array of variables de- 
signed to measure the impact of service, all of which were variants of process moasuvc 
These process measures included: 

1. Judgment by the caseworker as to the progress made by the girl in using the 
agency's services constructively. Baol^ground variables of the girls (race, religion, 
ijitelligence, and cli ical di.^gnosis) vreve o^iamined to determine whether they related, 
to the degree to which the girls were involved in using such service. Unfortunately, 
there was no examination of the background characteristics of staff,, as related to 
their ability to motivate or help their cixunts. 

2. Judgment made by the caseworker as to the effects of treatment. The Hunt- 
Kogan Movement Scale showed more positive results for group trectmeut. For the exper- 
imental sample, only one-fifth of all the girls wore judged to have changed or moved 
positively during treatment. 

School status at the end of the project. Twenty-nine percent of both the 
experimental and control cases had graduated high school at the termination of the 
project. Equal proportions had dropped out. There was no discfernible impact of the 
intervention on this measure. 

4. Highest school grade completed. Extremely small "differences in staying in 
school favor the experimental, cases. 
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5. Academic performnce. There was a positive selective effect of the treatncL 
program in reducing failing grades in academic subjects. i 

i 

6. School-related behavior. There usre no significant differences in attendanc 
rccordo. There xras slightly less truancy among experimental than among control sub- 
jects. There was no difference in conduct marks between the ejtperimental and control 
subjects. There were no real differences in teacher ratings on character and wrk 
traits. There were no real differences in ratings by guidance and counseling staff 
between the experimental and control subjects. 

7. Out of school behavior. There were no real differences in entries on health 
records, or in instances of out-of-wedlock pregnancy. 

8. Client Self -reports of effects. There are very scant differences, if any 
all, on measures of woll-being, perception of quality of Interaction with others, 
poychological insight and reactions to help, or assessment by seniors of thnir prcsen 
and future situations. 

9. Perscual.lty tests. Thare were no real significant differences in responses 
on the Junior Personality Qui^ or the Make a Sentence Tost, 

10. Soclomp.tric measures • There is no evidence of effect. 
Although there la an impressive array of these process measures which are analyzed, 
many were not systomatically collected and were not really meaningful for purposes 
of analysis. Rather, they were interesting observations about adolescent girls and 
agency staff. Unfortunately, there were no process measures designed to look at the 
effect of this experimental program on the agency staff or the school. Such would 
sefera to be almost as important as discerning the impact on the client if the program 
were to be generalised to other settings. 

Ouf c ome or performance . There were no long-range outcome or performance measure 
used in this study. It was apparently sufficient to show that even process or inter- 
mediate objectives were not fulfilled by the intervention strategy. But a study whi- 
8ougl}t to evaluate a delinquency prevention program would seem bound to at least try 
to assess a few long-term effects. 

The Silver lake EKperiment , LgMar T * Empey and Steven G. Lubeck. 1971 . 

Characteristics of subjects . The subject population consisted of 261 boys who 
were assigned by the courts from a common population of delinquent offenders in Los 
Angeles County. 

^ Once boys were selected for the project, they were randomly assigned to either 

the experimental or control program and the background characteristics of the subjec 
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in fthcije two prosrnms xyere compared on a host of background variables. Few differ enc 
X7cxe ODBsrved, but the e^tperimcntal program may have inadvertently been assigned r.oro 
serious or more experienced offenders. 

Many of these measures of background characteristics were combined into scales 
and were subsequently uced in analysis of predictor variables for both process and 
outcome differences. Thus, the scales of peer influence, background, offanse, and 
personality were consistently used throughout the report in explaining Inn^'j-inces of 
critical incidents, runaways, program failures, and program successes* 

Ir. torventioti ssttlnp: . There vere vsry clear distinctions in the sattiag for 
intervention for the control and experimental population and these differences were 
considered among the most crucial elements of the intervention strategy, Thq 
control prograji was housed in a large physical plant of the traditional institutional 
variety xvhile the 5tperimental program was located in a ranch style house in a reside 
tial neighborhood. The two programs also differed in size; no more than 20 boys at 
a time in the experimental program btit up to 125 boys in the control program. Boys 
in the experimental program returned to thaiJ Ov^jn homes on weekends and attended high 
schools in the community while boys in the control program lived there all the time a 
attended high school on the grounds. 

Actual differences in the staff -inmate ratio in the two programs were not given, 
but the quality and quantity of the interaction between staff and offenders differed 
between the two programs. A special questionnciire was constructed and administered 
to both the staff and boys in both the experimental and control programs. The instru 
ment dealt with the perceptions of the setting, among other things, and it verified 
that there ware indeed differences in the e:!cpected direction between the experimental 
and control programs* ^ "'^ 

The two programs differed considerably, not only in the flow and content of com- 
munication between staff and offenders, but also in the degree of community linkage 
with other agencies concerned with youth. The rule structure and sanctioning mechan- 
isms also varied in accord with traditional differences between custodial and 
treatment -oriented programs. 
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Tig^aatnient/fcechaology , .The authot^a repoiiied.tbat the control. was highly strnctur 
and t-radi^cAonaX w;lf.h maafe oaphaaxs placed on training, and Irdividual- counseling. 
Cuntodial factors were of moderate importance. Far more detailed information is 
provided about the experimental program, about theories of causation, treat!i:ent jnoda- 
litieSy at) J so forth. The basic technology was a variant of "Guided Group Interactioi 
The peer group was utilized as both . the target and the medium of change. The second 
important component of the technology 'was community linkage, providing a way in VJhich 
offori'lers could he reintegrn'ccd into norinal community roles. The e^^oeriraeutal unJ.c 
was located within the community; youth attGr.^eci; neighborhood • sclipc.ls, and had weekend 
home visits. 

During this research, both programs u-Asderwetit a series of majoi: organizational 
changes which were reflected in changes in treatment methods. The experiment -rl pro- 
gram imposed a strong negative sanction. against runaways sixteen months after it bega: 
The control program shifted from a conc^entration on one-to-one treatment to more grou: 
oriented modes and to more participatory forms of decision-making by both staff and 
boys. Both sets of changes were analyzed in terms of their relation to changes in 
process and outcome effbrts. 

EfJ^OjCt. The a':aount of effort put forth by the staff in implementing the prograir: 
cannot be determined acci:ratoly, because siifficient information was not given, but one 
got the impression of fairly high levels of effort in both the experimental and con- 
trol programs. More attention was paid to the efforts of boys to embrace or resist 
the different programs by asking them through interviews, questionnaires, and informal 
conversations about their own and others'. i^.valvcment in thia treatment process. 
Information was not provided, however, on the amount of effort put forth by boys in 
the school (there was no comparison of attendance records) at at work (there were no 
records of work attendance ot performerice). 

Process . Some interesting beh^vioi*al measures of the effects of treatment on 
participants were utilized, including runaway rdtes, patticipation in critical inci- 
dents, and program failures. The terminal runax/ay rates for both programs, covering 
O a two and one-half year* period, were relatively' high and very similar -- 377o at the 
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experimental program and 40% at the control program, but these rates were associated 
with different predictor variables in the two kinds of program. 

Critical incidents were studied only in the experimental program, so cross- 
program comparisons of participation were impossible. This type of analysis is impor- 
tant in correctional program evaluatioxis because it Is an enlightening process mea^ 
sure, not only in delineating the types of concerns that are defined as crisis- 
provoking for the program, but also in terms of organizational handling of crisis and 
the participants' responseo to it. ^ 

The program failure rates (those transferred or drop-outs) of both programs were 
much lower than the runaway rates. In both programs, failures were boys with the 
most persistent and serious offense backgrounds and personality problems. 

The summary measure of the process effect of treatment in the two programs was 
that no more than 46% of the experimental subjects, as contrasted to 507o of the con- 
trol subjects, successfully completed the program. The remainder were runaways or 
in-program terminees. Surprisingly, there was no information collected from the 
participants in either program at the point of termination or before with regard to 
their oxm evaluation of the experience or their assessment of the impact of it on 
their futures* 

This study dealt rather thoroughly with some of the negative effects of treat- 
ment on participants. Two particular aspects stand out: (1) There was evidence 
that the experimental program may have been overly concerned with custody and control 
(2) both programs were far more inclined tc punish boys for undesirable behavior 
than to reward them for desirable behavior. ^ 

This study was one of the few which compared the costs of the two programs and 
the average lengths of stay. The average monthly cost for the experimental program 
was $302.86 per boy, while it was $362.18 per boy for the control program. But the 
average length of stay for experimentals was 5.73 months as compared to 12.65 months 
for controls; thus, the difference in cost was considerable. The human costs for 
the boys were also less, for they had much more contact with home and their usual 
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iTplronment with shorter periods of confinement in the experimental program. Costa 
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xiere not exainlncd vLth respect to relative d5.f fcrences In humanenGSO, fairneos, or 
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juGti. 3 between the two programo, but this might have been pa^t of this type of pro- 
cess evaluation, ^ 

Ou tcomQ , Outcotn t was analyzed only in terns of recidivism in this study, but 
the xjays in which it was measured far ourpasoed\the usual recidivism reports. All 
eiri^ariucntal and cct\trol subjects runaways and failures, as well ao succcscfui 
graduates were followed for at leaf3t a year after their termination from either 
p::oct3ni. Recidivisra was atiulyzed in three different ways: (X) in ternin of number of 
offenses conunJ.tted by individuals; (2) in collective terms by comparing the total 
volume of delinquei^cy committed by subjects a year before entering the program with 
th3ir total volume coma^ltted a year after termination from the program; (3 in terms 
of the seriounness of the recidivistic ocfeases. This relative estimate of recidi- 
vism certainly has advantages over the movp^ traditional absolute approach. 

Most subjects in both programs seemed to have been relatively free of pcst- 
prcgi-am delinquency and there wao relative similarity in the amount of individual 
recidivism from both experimental and control programs. Subjects who did not coi^iplet 
either program were much more liksly to recidivate than those who did. There was a 
737o redx'.ction in the volume of delinquencj^ committed by the experimental subjects 
and 71% for control subjects during the twelve-month period after release, as compaxe 
to the twelve-month period before assignment to the program, but these findings are 
possibly due to regression effects. Both programs brought about a significant reduc- 
tion in the volume of serious offenses, suggesting that they were important sources 
of delinquency control. Although there was no assessment of long-term outcomes, 
these data do suggest that the experimental program, which was much shorter and 
thereby less costly, was at least as effective as the control program. 

Yo^^^^ Center Research Project , Csrl F , Jesness , William J. D^isi , Paul M. 
Mccormick , and Robert P. Wedg e, 1972 , 

Characteristic s of S ubject s, The subject population consisted of 504 wards of 

t!ie California Youth Authority, who were randomly assigned to the two programs — 

©•H» Close School which used transactional analysis or Karl Holton School which usud 
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behavior modification. These boys were compared on several dimensions of individu- 
al and background differences, but few differences were observed between the study 
populcj.fcions at the two schools. Despite the impressive array of data that were 
collected, none of these measures were later atialyzed for their relationship to 
measures of process or outcome effectiveueos, with the exception of the porsonalicy 
claBsification measures. 

Intervention setting , A primary objective of this research was to examine the 
dii:f3retitic-.l inpact of ttvO tGchnologioa in two inntitutiouG, Apparcni;l7 alike iu 
their orga-aizational structure, staffing patterns, and physical layout* Throughou': 
the pc:riod of the study, the organizational structure and the number and the types 
of pexconnel were almost identical. Tlie existing treatment programs at the two 
schools wore also almost identical, at baseline. The internal climate of th^ two 
schools was described in detail, but little information was provided about the en- 
viroxrmeiital setting in which they existed. They were situated adjacent to each 
other in Stockton, California, but there was no specification of how isolated they 
were from the rest of the city, how much commiunication existed between the two 
^schools, how much interaction there was between staff and boys from the two schools 
or the network of community resources that was 15-^ked to the schools. 

Tr eo tment / 1 echnoloR v > The h^jart of this research was its differentiation and 
comparison of two treatment technologies — Transacliional Analysis and Behavior 
Kodification. The two technologies were presented as somewhat idealized concep- 
tions of what should actually occur in their implementation, but differences v;ere 
apparent in the goals for the two technologies, the content of in-se3n;ice training 
sessions for the two sets of staff, the composition of treatment groups, the ways 
in which participants were rewarded and punished, the expected actions and routines 
of staff and boys under the two systems, and the expected changes in behavior and/ 
or attitudes. The two strategies were supposed to be particularly effective for a 
broad range of behavior and personality. 

Although the iTritten conception of the operation of the two technologies varie 
lER^C there was no indication that these differences pervaded all areas of ins^^itutiocal 
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life. The boys in both programs wont to school with their own hall group, and wore 
taught in an individualized, non-competitive manner. Both technologies involved heav: 
• use of group methods, contracts between staff and boys, emphasis on improved social 
adjustment, and a decrea^^e in the probability of delinquency. Readers would be aided 
by having descriptions of instances of differences in handling of the same behaviors, 
or differences in the kinds of rewards given for the same behaviors. More clear-cut 
differentiations in the actual operation of the program components were necessary to 
really understand that the differences in the two technologies were more than a mat- 
ter of differences In jargon. 

rffo rt . The extent to which eithar or both of the treatnicnt technologies were 
actually effectively implementGd is debatable. There were apparently quite serious 
problems in conveying to line staff that these technologies were more important than 
the issues of security, paperwork, or houGekeeping. The priority for the treatment 
program within each institution might have been different for there was data to suggct 
that Transactional Analysis uas actually impleinented more successfully than Behavior 
Modification. There wos no continuing in-service training for the staff in, Behavior 
Modification, but there was continuing tr^iining for Transactional Analysis. 

The researchers also took considerable pains in meaouring the effort of the sub- 
jects to embrace or resist the treatment techxiologies. These measures of effort of 
participants were then related to their maturity and ego levels. For all these mea- 
sures of effort, it was determined that staff and boys of both schools approximated 
the original expectations of the project, but fell short of the ideal. 

Process. One of the principal process effects examined was change in management 
problems within the institutions. Both programs, had an eventual drop in the number 
of incidents of misconduct reported, although initially the number rose. They also 
discovered that there was a continuing reduction in the number of residents sent to 
detention for misconduct, and when it was used, it was used for briefer periods and 
"for promoting change in behavior rather than for retribution." However, since these 
data were based on special incident reports written by staff in both institutions the} 
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tnny not be conparable. This indicator was more useful for examining trends within a 
single unit than in comparing two units. 

AIgo e^samlned were several psychological indices of process effects. Results 
from the Jesness Iviventory and the Post Opinion Poll showed positive psychological 
change in both units, but again Transactional Analysis subjects evaluated the program 
more positively. Observer ratings of behavior indicated greater behavioral change in 
the other unit as might be anticipated. 

There were many hypotheses vhich sought to relate the characteristics of nubjGCtc 
to ths process effects of the different kinds of treatment and they wern as follows: 

1. Transactional Analysis will be more effective with hiehcr maturity subjects, 
and this will be evident in their verbal behavior and in their observable 
behavior • 

2. Transactional Analysis will be most effective with higher maturity sub- 
jects who enter treatment expecting to change, and who receive high in- 
tensity and high quality treatment. 

3. Behavior Modification will be more effective in changing the behavior 
of lower maturity subjects. 

None of these hypotheses were clearly substantiated. Indeed, they found that the 
more mature subjects did better la both treatment programs. 

Unfortunately, negative process effects were not examined for either program. 
There was a consistently longer average stay for subjects in the Behavior Modification 
program than for those in Transactional Analysis. No information was provided about 
ccjt differences of the two programs, although one would assume that Behavior Modi- 
fication was more expensive since it had a longer average length of stay. 

Outcome or performance. Parole revocation was the only long-run outcome measure 
used, as was true in many of the earlier studies. They compared the subjects* rates 
of parole revocation for a 12-month period following release with those of inmates 
from the same institutions who had been released prior to the introduction of the 
treatment technologies and with inmates from two other institutions. It is important 
O to note here that they only looked at the rates for successful graduates, not for 
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runswayo or in-program failures, and they did not cotnpare these rates with the pricr 
delinquency of the subjects as was done in the Silverlake Experiment, 

In a 12-month parole exposure period, only 31% of the Transactional Analysis 
subjects and 32% of the Behavior Modification subjects of the same age had been re- 
moved from parole, and these figures were significantly lower than those of the con- 
trol groups. IJo other outcome measures ware used so recidivism again reigned ac the 
supreme criteria of effectiveness. 

A_ rcTTT PArnt-Sv e Afi flfiSBtnGt it of Proba trlon P ractices and Pergpectivcs, Stephen Bu7.-/;V.ardt , 
Rose Piarv C . .Gnrri and Carl GoTTlke. 1971 . 

ChsracCprigtilr.G of Subjects. The subject population con:;i.ctcd of offenders 
vho were assigned to probation In a large mid-western city; offenders in a ncv7 insti- 
tution utilising a differential treatment model and offenders in a traditional 
training sr.hcol progran. 

All of these populations were compared in terms of the background and social 
characteristics. The probation population selected was slightly older, mors ur- 
banized, had more years of education, and had a higher proportion of Blacks than the 
institutional population. The probation population was differentially classified 
on the bs^sis of personal characteristics for service. 

Few significant differences were observed in the ccimnitinent offense character- 
istics of the institutional and probation samples, but the institutional population 
had a larger proportion of offenders with more offenses. This same distinction be- 
tween the number of offenses committed also holds for three types of probation 
gro^jips -- there was a direct relationship between the number of past incidents and 
the type of caseload - (i.e. minimal, normal, intensive) to i?hich an offender was 
assigned. The fewer the number of incidents, the greater the chance of being placed 
on a caseload with minimal service interaction. However, for the most part, the 
data in the background and offense charactqristlcs of the several populations were 
striking because of the similarities they revealed between the probation and insti- 
tutional populations, not the differences. These data refuted the often-stated* 
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&3SGrtion that probationers are less serious offenders. 

The background characteristics of offenders were not controlled In the analysis 
of process outcomes, though this was partially fulfilled because of the Interaction 
between disposition (I.e. type of probation caseload or Institution to which the of- 
fender was assigned) and his backs^^ound characteristics. One of the striking but ten- 
tative conclusions thay drew from the analysis of the relationship of race to dispo- 
sitional outcome was that Blacks from the s^tne social class and of equal educational 
achievement as the whites on "intensive" caseloads were not asalgnsd to nrobatilon at 
all but probably were "tracked" into institutions. Data were insufficient, however, t< 
test this hypothesis. 

Intervention Setting . There wei*e marked differences in Intervention settings 
for the throe programs. Probationers all lived in a large, mid -western city on their 
oxm while the institutional populations were housed in large complexes in riirr^^l areas. 
The programs were characterized by placement on a continuum of restrictive to non-re- 
stiricuive milieu, and this facet of the intervention setting clearly was the crucial 
distinction between probation and the institutions. 

- T reatment /technoloi:>y . the Probation Office utilized the "San Francisco Plan" 
for classification of offenders and caseload assignment. Using the criteria of age, 
probation offense, psychiatric test scores, and prior offense record, probationers 
were placed in minimal, normal, and intensive caseloads so that needs were matched 
with services. The actual strategies of intervention with probationers were not, how- 
ever, systemmatlcally explicated. Service and the ways in which it was to be given, 
the content of discussions and the techniques of treatment were not reported suffic- 
iently. 

Both institutions functioned under similar general guidelines on training and 
custody, but there were significant differences in their technologies. The signi- 
ficant differences in the actual and desired goals for the institutions perceived by 
the staff were reflected in clear differences in the following dimensions of treatment 
technology: emphasis on process goals of custody and control, and treatment /community 
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Invoiveaeat as opposed to product gonls of education end rehabilitation j the degree 
of cciaplexity and sophistication of the technology and the degree to which the tech- 
nology emphasized interpersonal relationships between staff and clients or social dis- 
tance between staff and clients* 

Effort, Measures of the effort of staff included: 

(a) relative axaount of time spent In various aspects of service; 

(b) offender and staff perceptions of the efforts of staff to care for and 
and holp offcnrlnrs; 

(c) reports from both the staff and offenders of the freijuenc}' of discussion 
of personal problems; 

(d) rcpo/Tto of probation officers and probationers with regard to effort at 
referral to schools, employment agencies, hospitals, vocational rehabili- 
tation, ano other agencies but no comparable information for institutional 
staff. 

The only measures of offender effort included in this report were : 

(a) Offenders reports about problem-Rharing with probation officer, minister, 
family, friends, and so forth; 

(b) Efforts of probationers to contact referrals. 

Procoss. This study was primarily concerned with the effects of service on 
clients during aiid at the point of termination from the program. A large array of 
process measures were collected, includiijig the following: attitudes of staff with 
regard to their interest and involvement in service technologies, tholr type of inter ^ 

action with young offenders, and their attitudes toward offender change efforts; 

( 

offenders? perceptions of their ln*:eractlon with staff, their optimism about the 
future, feelings of self-esteem, and faith in people. 

Trobation staff had more positive attitudes toward offenders and their chances 
for improvement than institutional staff, and were more interested in factors related 
to changed goals for clients. The typical probationer -probation officer relationship 
compared favorably wl.th the perception of interaction between staff and offenders in 




the institutions but significantly fewer probationers felt that they had been helped 
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in either job training or vtih matters relating to problems outside probation itself 
than x^ao true in the institutional population. 

The researchers also considered t>*a question of the relative cost of the prosrac: 
The estimates of the per client cost per day in the various programs is as follows: 
$1S,S0 for an inmate in the traditional unit; $30.00 per day in the new program; and, 
$1.09 for a probationer /parolee. Thus, there was little convincing evidence from ir.he 
comparison of process measures for widespread lnotitutionall«zatlon of young offenders. 
Sata \72rG insufficient for comparlGon about tha relaUlve lengths of stay in each of 
these programs. 

Outco Tne or p erfoytn since . The researchers did not utillss any long-term indica- 
tors. They relied e::clusiveiy on intermediate mearx^res of effectiveness, referred to 
in the earlier sections, although allusions were made to the relationship of effective 
process outcomes f|nd long-run impact. 

A STII>1M\? .Y C?.1TXQ UB 

The adequacy with which the researchers in those six studies evaluated progrciiris 
will bo summarized in a series of small charts for each dimension follotced by a brief 
discussion of the overall strengths end xv^eaknesses of the analysis of these dimensions. 
The reader is cautioned, however, that these judgments are crude and somewhat r Abjec- 
tive, and do not -reflect the differences in objectives, units of analysis, problems, 
and resources ava^lcble. 
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For the most part, researchers handled the explication and measurement of cub* 
ject variables adequately, though there was a tendency to measure a large number of 
them without any apparent theoreticol r<siason for so doing. In most cases they were 
used primarily to show the comparability of the experimental and control papulations 
but were not syctemmatically analyzed for their relationship to the effects of treat' 
mont. For eztample, every one of the studies looked at race in comparing the experi"* 
mental and control groups but race was never further analyzed in terms of the extent 
to which there vere dif fcr'^titial rates of effcctivenccc in process and oaf.corce based 
on race of the subjects. This would seem to bo a rather important onisoion in the 
study of programs which handle disproportionate numbers of minority group nnmb-^rs. 
Fir.aliyl because ttore weren't vnany efforts to compare the population characteristics 
of the subjects with those of other correctional populations, these studies arv2 sub- 
ject to the criticism of the inability to generalize from them to the correctional 
popv.lation in general. 



Intervention Setting 
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Most of these studies suffered from lack of attention to the effects of the 
intervention setting on evaluation process and outcome, particularly in the areas of 
goal description and analysis and the environmental context of the program. In only 
two of the studies (Jesness et al, 1972 and Meyer et al^, 1965) was any mention made 
of any changes in aspects of the intervention setting during the course of the researcl: 
but we suspect that such change is fairly common in most settings and must be dealt 
with in designing such evaluative research designs. 
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The doiineation and description of the methods of treatment was clearly a pro- 
blcamatic area although ell authors described some abstract conceptions of technology. 
In umy of tl::c:n, there \vasn*t even any coasparable information given for the expari- 
mental and control groups with regard to the relative amounts of individual or group 
treatment; the premises underlying the choice of the technology with regard to pro- 
bli?,m caucation, types of subjects most amsnable to treatment, and priorities for pro- 
blem focus; cr clearly stated treatment objectives, llorcover, none of them adequately 
handled the actual implementation of the technology with regard to differences in 
methods of social control, revrards, restrictions, content of treatment oeoslons, 
locus of authority and decision-making end backgrounds of treatment personnel. In 
two of these studies, there were very clearly reported shifts in the technology 
daring the course of the research (Meyer ejt al^, 1965 and Empcy et al^, 1971) and in 
both of those the results were clearly related to differences in process effects. This 
is an important step and future research designs should be flexible enough to incor- 
porate such changes into the tot»el assessment of [Impact. 
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Most of thevse studies related few measures of .the effort of staff to the goals 
and techr4ologic6 of the program. Usually effort meant the frequency of contact t;ith 
subjects and/or the nuaiber of interviews, group meetings, or counselling sessions 
held. With few exceptions, there was no effort to relate these measures of effort to 
the eventual process or outcome effectf3. The attempt to measure the effort of tha sub 
ject^s was even more truncated, though oue would assume that such effort shoulJ affect 
the kinds of individual effects that occurred « 
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There are huge z^ryQ in the conccptuali*:ation and measurement of process effects 
in most of these studies, although a few of the studies used a multitude of tham. 
Some of the studies used a variety of behavioral measures of process effects to the 
exclusion of the subject's o^jn attitudes and evaluation while others proceeded in the 
opposite way. Few of these studies used any measures of the effects of the program on 
the staff or the agency with regard to staff morale, turnover, agency innovation, 
agency interaction with each other, organizational and community networks, and so fort 
More than half of them did not include any statement of the costs of the program 
though most of them did evaluate the length of stay involved. Although the positive 
effects of those programs wore always emphasized, little attention was given to the 
negative effects. 
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In half of these studies, there were no measureo of long-run itapact of the 
prograai on the offenders or program at^ all and in the other half, the only measures 
aca<i wG^^i related to recidivism or parole revocation. Tht? measures of recidivism 
which were used, with one excGptlon, were rbsolute and did not take into account the 
past history of offenses committed by the subjects. In an earlier section of the 
paper we discussed the importance of relative measures if recidivism is used as an 
outcome criterion. 

Because recidivism was used so extensively, there was virtually no attention 
paid to other possible negative long-run effects of these programs such as stigmati- 
zation, decreased educational and occupational achievement, and feelings of injustice 
and anger. Furthermore, there were no efforts to look at any long-run pceltivQ 
effects of these pr^grzijas - such as^ educational :ar.hievement, vocational training. 
Increased positive interaction with family. and friends. In many of the programs, be- 
cause there were no discernible positive features of process., outcome measures were 
not attempted, 

L PLAN FOR COMPARATIVE ASSESSMENT 
Our present research involves assessment of a limited number of varying types 
of juvenile correctional programs in a number of states in all regions of the country 
(Sarri and Vinter, 1972). This is policy-related research which seeks to identify 
the range and variety of present policies in juvenile correctional programs through- 
^out the country, their relative effectiveness and ineffectiveness; what new alterna- 
^ tives might or are being developed; and how specific change cs^ be brought about. 
Effort is being made to meesure critical experiences and outcomes for of it 'ers in 
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each of these programs. Organizations, however, rather than individuals are. the pri- 
mary object of analysis so rations, rates and probabilities will be calculated for 
groups of individuals. Furthermore^ the assessment focuses more on the events within 
the temporal and social boundaries of the organization providing service, although 
some attention is given to cross -boundary relations, offenders careers within organ- 
ization-sets, and post-program behavior. 

In developing a plan for identifying operational criteria, we considered the 
three targets identified earlier j program outcomes for indivuBis and organizations; 
organizational processes and effort, and inter -organizational processes and effort. 
Correctional units were classified according to a typology of the major functions 
performed by different agencies within juvenile justice systems: prevention and 
social control (e.g. youth service biireaus and community diversion units); identi- 
fying and nominating youth as offenders (e.g., police and school referral units); 
processing and referring offenders (e.g., court intake, diagnostic services); adjudi- 
cating offenders (e.g., juvenile courts); containing and controlling offenders (e.g., 
detention facilities, jails, custodial institutions, some probation and parole ser- 
vices); treating offenders (e.g., some probation services, community -based programs, 
some rehabilitative institutions); and, re-entry for offenders (e.g., some parole 
services, work release, job placement, some ex-offender organizations). This typologj 
facilitates differentiation between units having the same general labels, but which 
may employ contrasting technologies or whose intended purposes are clearly different. 

Our more elaborate classification of the functional categories of juvenile cor* 
rections was collapsed into four major groups for purposes of assessment: detention 
programs, processing, change and control, and exit management or re-integration pro- 
grams. This classification recognizes that some corrections a^.rvica units employ a 
combination of programs for part or all of their offender populations. It combines 
organizations that may pursue contrasting goals because. their functions, programs, 
atid results must ultimately be compared* 

Questions had to be resolved about the relationship of fairness, humaneness, 
and Justice to effectiveness before operational criteria could be formulated, as we 
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mentioned earlier. The assumption was made . that humaneness, fairness, and justice 
were essential preconditions for any effective program. Thus, the decision was made 
to Treasure then Ind^pendeiitly of otlier meastires of effectiveness. A set of standards 
of the National Advisory Commission of Standards and Goals (1973) is being adapted 
for this measuromont. Illustrative of the criteria for humaneness and justice in 
handling offenders are the following: 

1. Adequacy of sustenance conditions. ; 

2. T^aturo and scope of interacnion with pears \ar;d family mcubers. 
3» Access to and use of community resources.- 

4. Dug process and other protections of inclitridual rights, 

5. Degrae of restrictionc imposed on offenders. 
6- Extent of segregation of faciHtlQS; 

7. Extent of discriminatory handling due to offenders' ascribed characteristic: 

8. Provisions for insuring the right to treatment. 

The criteria for evaluation which are presented in the following section in- 
volve both program outcomes and or^^anipatlonal processes.. They are drawn from our 
review of the evaluation literature on correctional programs and from studies of 
other human service organizations, the availability of several comparative studies 
of juvenile correctiont: was a great asset In- selecting criteria. Among these studies 
are the Pappenfort and Kilpatrick (1970) census of children's institutions; the 
Street, Vinter, and Perrow (1966) study of institutions for male delinquents; the 
Lerman (1968) and Bailey (1966) reviews of correctional ou;.comes; and several exten- 
sive reports about evaluation design; methodology, process, and outcome, including 
the xrprk of Rossi and Williams (1972), Weios (1972), and Caro (1971). Criteria used 
for selection included the following: (1) linkage to major policy questions mandated 
for the research; (2) relative ease of measurement; (3) potential for achieving oper- 
ational comparability across units, communities, £(nd states; (4) theoretical rele- 
._^vance and potency; and (5) observed empirical potency. 
Q Program Ou tcomes. These refer to the degree to which orgariiEations achieve 
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m^sam their intended results at both the individual offender (target population) and organ- 
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isational levels. Since both manifest and latent (positive as well as negative) 
results are being observed, the ration between them provides one summary measure of 
relative effectiveness. Illustrative variables about vhich data are being collected 
for each major program category are presented below. These criteria are not meant 
to be comprehensive; in general, the research strategy calls for a parsimonious 
range and choice of data collection measures. In the case of each type of program 
the criteria are being operationally defined. This process will be illustrated here 
only for one type of program, 'Me.tontion, " but che process is similar for the other 
types. Detention as a type of program is contrasted from the others because effect-* 
iveness is maacured with respect to resfrrictivenesf? of the custody, th3 length of 
stay, the nuuiber of youth detained, and the proscense of screening procedures, more 
than with respect to the quality of the dnCiention care per se. This is not to indi- 
cate that quality of service delivered is unimportant, but to specify other importan 
criteria for a unit that is only to hold youth for prodessing prior to adjudication 
or disposition. 

Detention Proj^ram s . 

1. Type of detention and average length of stay. 

The less restrictive the detention and the shorter 
the length of stay, the more effective the unit. 

2. Proportion of persons detained who have hearings within 24 hours. 

The higher the proportion o£ hearings hold within 24 hours, 
the more effective the unit. 

3. Percentage of juveniles detained for felonies. 

The higher the proportion of the detained who are charged 
with serious felonies, the more effective the unit. 

4. Percentage of juveniles who are subsequently institutionalized. 

The higher the proportion of those detained wh are 
subsequvantly institutionalised, the more effective the unit. 

5. Offenders' perception of living conditions, the more effective the unit. 

The more positive arc^of fenders ' perceptions, the more 
effective the unit. , 

6. Staff effort to curtail the domain of detention. 

The greater the staff effort to limit the use of physically 
resS:S'icting custody and to develop other alternatives for 
assuring court appearance, the mot.e effective the program. 



42 

7. Independent observers* assessment o£ detention programming. 
The more positive the ratings of education, diagnosis, 
medical care, and so forth, the more effective the program. 

Processing Programs . For units primarily concerned with screening, adjudica- 
tion, and referral, the extent to xrtiich dispositions vary and correlate with dif- 
ferences in offenders • social characteristics (including offenses) constitutes a gen* 
eral measure of outcotnQ, Organizational effort and process variables have particular 
importance for these organizations because of, their crucial role in decision-making 
rogfirding tho. statue of youth, 

1. Extcnsiveness of offender screening and diagnosis, 

2. Congruences between diagnoses and disposition outcomes. 

3. Percentage of juveniles referred to non-icolating and non-stigmatizing 
service programs, 

4. Nature and amount of service delivered per offender. 

3. Proportions and characteristics of juveniles whose case-processing 
shews adherence to due process procedures, 

6, Offenders' generalised evaluations of the processing and quality 
of services received. 

C hange and Control Programs. Although theae programs are differentiated ac- 
cording to community location, goals, degree of instttutionalisation, etc, key 
variables are isolated for the assessment of each type of unit. Three facets for 
measuring outcomes are considered: (a) offenders' generalised appraisals of the 
program and organization; (b) nature and extent of preparation for offenders' re- 
integration into the convent ioncl world; (c) relation between service received and 
subsequent recidivist behavior of offenders, 

(a) Generalized offender evaluation of the program, its goals, policies, and 
technologies; functions, patterns, and structure of friendships and other 
informal systems; offender grovth in self-esteem and self -Icnowledge; 
ability to handle stress and frustration; independence, and individuality; 
and relative optimism regarding future. 

(b) Degree and type of preparation of offenders for reintegration into the 
conventional world, 

1. Levels of educational preparation and achievement* 

2« Extent and content of vocational training and levels of achievement. 
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3. Extent and scope of occupational experiences provided by the 
programs, and levels of participation. 

4. Nature of preparation for return to family, peers ^ and coniraunity 
situations. 

5. Behavior of youth In relating to conventional social roles 
(work release, passes, etc»)- 

(c) Recidivist behavior of offenders in relation to service received. 

1. Extent and type of post-unit offenses by self -report with controls 
for age and pre-program offense history. 

2. Duration of avoidanca of new offenses. 

3. Extent of integration into non -criminal social roles. 

E:cf,t ManaRetnn t and Reintngration Prop , r?jn9^ Concrete exaa-ples of such progranis 
are parole, aftercare, pre-release ceatr.rc, etc. We expect to find fewer units pro- 
viding such services and proportionately far fewer than for adult corrections systems 

1. Percentage of offenders recommitted to correctional programs. 

2. Offenders* perceptions of and judgments about re-entry services 
received. 

3. Offenders' self^reports of legally proscribed behavior. 

4. Percentage of offenders in vocational or academic training programs. 

5. Percentage of offenders employed. 

6o Extent and frequency of staff intervention in the community on 
behalf of offenders. 

7. Average amounts of service received by types of offenders. 

8. Extent of off ender -staff planning of the reintegration process. 

Or R anl zat 1 onal Provesses and Effort » Measures of phenomena or results at one 
level of assessment may be analyzed as measures of effort or process at another level 
In studying organizational processes and efforts, we will attempt to identify effic- 
iently those elements that contribute most to units' intended results or purposes. 
Again, it is assumed that organizaticual processes may have either poaitive or nega- 
tive consequences, or both, for these ends. 
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Organisational Goals 

1. Content and specificity of goals. 

2. Priorities among multiple goals (e,g., treatment, rehab ili tat ion j 
staff morale, custody, etc.). 

3. Staff commitments to goal priorities. 

4. Offenders' commitments. to the organization's goals and their 
priorities • 

Executive leadership. 

1. Executives' goal priorities and coinrcttnents. 

2. Nature of executives' relations with external units within the 
juvenile juotica system, and V7ith other agencies providing services 
to juveniles, etc. 

3. Conmittiicnts to r'liarige and inaovation. 

4. Staff identification xrith iT/?.nbers of executive cadre. 

5. Degree of centralization of policy-making and decentralisation 
of operational decision -making. 

6. Relative power of rehabilitation-treatment cadre in organizational 
decision-making. 

Organizational structure and progrcm technology. 

1. Specificity of objectives for components within units' 
technological systems. 

2. Staff division of labor hased on differential task and skill 
requirements . 

3. Levels of staff skills and amount of training required for 
technological tasks. 

4. Articulation between technical system components, and between 
these and staff structures and rclcs. 

5. Amount of resources allocated to rehabilitation-treatment technologies. 

6. Ratio of staff performing rehabilitation-treatment roles to those 
performing maintenance and cuctoclial roles. 

7. Tat terns of interaction and communication among sub-units within 
the organization — formal and informal. 

8. Degree of adaptability of the technical systems to changes in 
both offender populations and environmental conditions. 

9. Offender truancy or "AWOL" rates. 
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Staff -Of fender relations • 

1» Ratio of staff to offenders both total and for staff sub-groups. 

2. Degree of support by staff for development of informal offender systems • 

3. Extent of positive primary group relations between staff and offenders 
and staff-offender social distance. 

4. Degree of staffs' non*-stigmatizing perceptions of offenders. 

5. Offenders' perceptions of staff as helping persons. 

6» types of rewards and punishments employed by staff and organiza- 
tional contt^ols over their use. 

?• Ratio of grGtification to deprivation for offenders. 

8. Degree of offenders' participation in decision-making about major 
areas of organizational activity. 

9. Extent to which due process procedures are adhered to in managing 
daily living and control' of offenders. 

Inter-organizatlonal Processes and Efforts. Our concern at this level will be 
directed toward the effectiveness of service units in relation to their environments • 
It Is recognized that the nature of units' environments, including those under pri- 
vate auspices, may be variously manifested or defined within and between the states. 
Effectiveness at this level is to be assessed in terms of organizational adaptabil- 
ity; organizational legitimacy; relations with regulatory groupo; mobilization of 
resources; control over input and output (including offenders); relations with com- 
plementary organizations; and total level of exchanges with other units and organ- 
izations in the external environment. 

1. Degree of resource control by the service unit. 

2. Degree of autonomy in determining service unit policies and program content. 

3. Routinization of linking mechanisms for Inter-organizatlonal exchange. 

4. Degree of monitoring of exchanges. 

5. Provision for feedback and adaptation. 

6. Degree of congruency in expectations between unit and external agencies 
relevant to the unit. 

7. Stability and rate of increment in resources for priority goals. 
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Many of the above criteria require greater specification before they can be 
measured reliably and validly. It is also expected that the total number of criteria 
can be reduced as more information is obtaihed about each type of program so as to 
be able to determine relative criticality for comparative assessment of effectiveness 

Conclusion 

We have attempted to delineate some of the major issues and dilemmas in the 
evaluation of effectiveness in Juvenile corrections. The analysis of several pro-* 
grams reported in the literature highlighted the serious problems in evaluation 
methodology^ as well as the grim picture with respect to knowledge about technol-- 
ogies that will produce greater outcome success. To achieve this end, evaluation 
of process is as important as is measurement of outcome per ae. Only when we can 
establish linkages between events within the progran and subsequent outcomes can 
we have the knowledge that is needed for policy recommendations. Yet, most eval- 
uative research continues to expend more resources on unrelated measurement of in- 
puts rather than process and outputs. 

Correctional organizations employ highly varied people-processing and people- 
changing technologies to achieve both manifest and latent ends. Yet, criteria for 
choice among technologies remain unclear and often are non-existent. Instead, 
choices are based on fads and hunches without reference to input characteristics or 
output objectives. 

Thus far evaluation in human service organizations has focussed primarily on 
program implementation phases rather than on assessment of program design, planning 
and formulation. Weiss (1972) argues that greater priority should be given to the 
latter so that knowledge will be obtained about how to avoid or cope with organ- 
izational and environmental problems which often occur. The evaluation literature 
is filled with reports on major organizational changes which have occurred in the 
O middle of the evaluation effort. In most cases these were unanticipated and re- 

ERIC 

'™™" searchers decried thei problems credited in adaptation, measurement, and so forth. 
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Such change needs to be anclclpaced as a likely rather Chan an unusual event. Eval- 
uative research will also be different and probably more difficult than other types 
of social science research because it deals directly with reality in settings where 
research is not the primary activity. 

The politics of evaluation were dealt with only peripherally in this paper, 
but they are of critical importance to the researcher today whether he or she likes 
it or not (Rossi and Williams, 1972; Weiss, 1972). The scientist must anticipate 
how his findings will be read, misunderstood, ignored and distorted. He must be 
prepared to explain at other than a superficial level why the results were ob- 
tained and what alternative meanings they may have. Over and over the findings frou 
evaluative research report that the null hypothesis of no change was supported. 
The question then arises: does that mean that the organization had no impact or 
that the proper dimensions of organizatiorial behavior were not measured? Only 
infrequently are such questions considered. 

Evaluation inevitably has political implications, for it is the means by which 
the character of a program or organization is described and analyzed. Social values 
are always involved and must be addressed as such. Many recent observers have 
referred to the increasing politicization of Juvenile Justice systems in several 
countries. This phenomenon will further add to problems in evaluation for in- 
creasing pressures will be exerted on researchers. For exampley we are in a period 
of rapidly escalating costs in all correctional programs, so legislators and others 
are looking for information which will be of use in resource allocation decisions. 
When the cost of institutionalization for a Juvenile offender now exceeds $20,000 
per year (as it does in several places), decision-makers will exert great pressure 
to obtain evaluative data about both process and outcome. Of even greater impor- 
tance than costs are the social consequences of correctional experience for indi- 
vidual youth and for the society as a whole. Social scientists must be willing to 
decil with these and other value and policy questions. Such situations provide op- 
portunities to enhance tho development of better evaluation methodologies and the 
utilization of research findings. ( 
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